System and method for distributing auxiliary data embedded in video data

ABSTRACT

A system and method for distributing auxiliary data embedded in video data includes a content source that embeds the auxiliary data into the video data. The content source then encodes the video data together with the auxiliary data to create a distribution multiplex including compressed video data. A decoder receives and decompresses the distribution multiplex to reproduce the video data with the auxiliary data embedded. A television or other device then detects and extracts the auxiliary data from the video data. The television or other device processes the auxiliary data to support a variety of possible interactive applications including displaying a synchronized widget on a display of the television.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority in, U.S. Provisional Patent ApplicationNo. 61/251,099 entitled “Video-Embedded Metadata” that was filed on Oct.13, 2009. The foregoing related Application is commonly assigned, and ishereby incorporated by reference.

BACKGROUND SECTION

1. Field of the Invention

This invention relates generally to techniques for implementingtelevision systems, and relates more particularly to a system and methodfor distributing auxiliary data embedded in video data.

2. Description of the Background Art

Implementing effective methods for distribution of metadata withindigital television systems is a significant consideration for designersand manufacturers of contemporary electronic entertainment systems.However, effectively implementing such systems may create substantialchallenges for system designers. For example, enhanced demands forincreased system functionality and performance may require morecapabilities and require additional hardware and software resources.Impediments to the effective delivery of metadata in advanced systemsmay result in a corresponding detrimental economic impact due tooperational inefficiencies, lost revenue opportunities, and reducedfunctionality.

Furthermore, enhanced system capability to perform various advancedoperations can offer additional benefits to the end user, but may alsoplace increased demands on the control and management of various systemcomponents. For example, an enhanced electronic system that effectivelysupports synchronized television widget functionality may benefit frommethods providing flexible carriage of the data stream supporting thisfunctionality.

Due to growing demands on system resources and substantially increasingdata magnitudes, it is apparent that developing new techniques forimplementing and utilizing data distribution through digital televisionsystems is a matter of concern for related electronic technologies.Therefore, for all the foregoing reasons, developing effective systemsfor implementing and utilizing data distribution through digitaltelevision systems remains a significant consideration for designers,manufacturers, and users of contemporary electronic entertainmentsystems.

SUMMARY

In accordance with the present invention, a system and method aredisclosed for distributing auxiliary data embedded in video data. Inaccordance with one embodiment of the present invention, a contentsource or other appropriate entity initially produces content data thattypically includes video data and audio data. The content source orother appropriate entity then creates auxiliary data to support advancedinteractive features such as “synchronized widgets” or Internet-enhancedinteractivity on a television device. The content source or otherappropriate entity inserts or embeds the auxiliary data into the videodata.

The content source or other appropriate entity then encodes the audiodata and the video data (including the embedded auxiliary data) tocreate a compressed distribution multiplex. The content source or otherappropriate entity distributes the distribution multiplex in anyeffective manner to a television in an electronic network. In certainembodiments, a decoder device of a set-top box or other appropriateentity receives and decodes the distribution multiplex distributed bythe content source to reproduce uncompressed audio data and uncompressedvideo data (including the embedded auxiliary data).

A detection module of the television scans the video data to locate theembedded auxiliary data by utilizing any effective techniques. Next, anextraction module of the television extracts the located auxiliary datafrom the video data. Finally, an auxiliary data module of the televisionprocesses the extracted auxiliary data to successfully display andsupport one or more interactive applications residing in the television.For all of the foregoing reasons, the present invention thus provides animproved system and method for distributing auxiliary data embedded invideo data.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A is a block diagram of an electronic system, in accordance withone embodiment of the present invention;

FIG. 1B is a diagram of a display from the television of FIG. 1A, inaccordance with one embodiment of the present invention;

FIG. 2 is a block diagram for one embodiment of the content source ofFIG. 1A, in accordance with the present invention;

FIG. 3 is a block diagram for one embodiment of the source memory ofFIG. 2, in accordance with the present invention;

FIG. 4 is a block diagram for one embodiment of the auxiliary data ofFIG. 3, in accordance with the present invention;

FIG. 5 is a block diagram for one embodiment of the television from FIG.1A, in accordance with the present invention;

FIG. 6 is a block diagram for one embodiment of the TV memory from FIG.5, in accordance with the present invention;

FIGS. 7A and 7B are diagrams of auxiliary data embedded in video data,in accordance with two different embodiments of the present invention;and

FIGS. 8A-8C are a flowchart of method steps for distributing auxiliarydata, in accordance with one embodiment of the present invention.

DETAILED DESCRIPTION

The present invention relates to an improvement in television systems.The following description is presented to enable one of ordinary skillin the art to make and use the invention, and is provided in the contextof a patent application and its requirements. Various modifications tothe disclosed embodiments will be readily apparent to those skilled inthe art, and the generic principles herein may be applied to otherembodiments. Thus, the present invention is not intended to be limitedto the embodiments shown, but is to be accorded the widest scopeconsistent with the principles and features described herein.

The present invention is described herein as a system and method fordistributing auxiliary data embedded in video data, and includes acontent source that embeds the auxiliary data into the video data. Thecontent source then encodes the video data together with the auxiliarydata to create a distribution multiplex including compressed video data.A decoder receives and decompresses the distribution multiplex toreproduce the video data with the auxiliary data embedded. A televisionor other device then detects and extracts the auxiliary data from thevideo data. The television or other device processes the auxiliary datato support a variety of possible interactive applications includingdisplaying a synchronized widget on a display of the television.

Referring now to FIG. 1A, a block diagram of an electronic system 110 isshown, in accordance with one embodiment of the present invention. Inthe FIG. 1A embodiment, electronic system 110 may include, but is notlimited to, a content source 114, a set-top box 118, an interface 126, atelevision 122, an optional network 134, and an optional server 130. Inalternate embodiments, electronic system 110 may be implemented usingcomponents and configurations in addition to, or instead of, certain ofthose components and configurations discussed in conjunction with theFIG. 1A embodiment. For example, any number of televisions 122 may besimilarly deployed in electronic system 110. In addition, network 134and server 130 may not be included in all embodiments of the presentinvention.

In the FIG. 1A embodiment, content source 114 may be implemented as oneor more electronic devices or other entities that prepare and distributecontent data, including video data and audio data, for reproduction bytelevision 122. In the FIG. 1A embodiment, content source 114 may beimplemented as any appropriate entity. For example, content source 114may include a television broadcasting facility, a satellite televisiondistribution facility, or an Internet server entity. Additional detailsregarding the implementation and utilization of content source 114 arefurther discussed below in conjunction with FIGS. 2-4.

In the FIG. 1A embodiment, content source 114 creates an encodeddistribution multiplex containing the content data in a compressedformat, and then distributes the distribution multiplex through adistribution network via path 116 to a decoder device. In the FIG. 1Aembodiment, the decoder device is implemented in a set-top box 118.However, in other embodiments, the decoder device may be implemented asany appropriate entity, either external to, or integral with, television122. In certain embodiments, additional devices or entities may beinterposed between content source 114 and set-top box 118. Examples ofsuch entities may include, but are not limited to, a broadcast networkaffiliate and a service provider (such as a satellite or cablehead-end).

In the FIG. 1A embodiment, set-top box 118 decodes the encodeddistribution multiplex to generate uncompressed A/V data (video data andaudio data) that is provided to television 122 via an appropriateinterface 126. In the FIG. 1A embodiment, interface 126 may beimplemented in any effective manner. For example, interface 126 may beimplemented according to a High Definition Multimedia Interface (HDMI)standard that provides a high-speed parallel interface to deliveruncompressed video data and audio data, and control/timing signals totelevision 122. Television 122 may then responsively receive andreproduce the video data and audio data for utilization by a systemuser. Additional details regarding the implementation and utilization oftelevision 122 are further discussed below in conjunction with FIGS.5-6.

In the FIG. 1A embodiment, electronic system 110 supports the creationand display of various types of “widgets” on television 122 in additionto the main content data. Widgets may include discrete areas that aredisplayed on television 122 to provide any desired type of information.Additional details regarding widgets are further provided below inconjunction with FIG. 1B. In the FIG. 1A embodiment, electronic system110 advantageously supports synchronized widgets that provideinformation that is related to (synchronized) to the main content datathat is currently being displayed on television 122. In order tosuccessfully support synchronized widgets, electronic system 110 alsoprovides certain types of auxiliary data to television 122.

In various embodiments, television 122 may obtain auxiliary data fromany appropriate source including, but not limited to, content source 114or server 130. In the FIG. 1A embodiment, television 122 may communicatewith server 130 via any effective network 134 including, but not limitedto, the Internet. Additional details regarding the creation,distribution, and utilization of auxiliary data are further discussedbelow in conjunction with FIGS. 4, 7, and 8.

The present invention generally involves embedding auxiliary data in avideo signal so that the auxiliary data may be quickly and easilyrecovered by receiving devices like television 122. In certainembodiments, content source 114 inserts auxiliary data within adistributed video signal so that the auxiliary data travels through thedistribution chain, comes into a consumer's home via a compressedinterface (from a cable, satellite, or IPTV service provider), isde-compressed in set-top box 118, and then travels to television 122 inan uncompressed format, where television 122 retrieves and utilizes theembedded auxiliary data to support synchronized widgets. The foregoingtechniques are intended to circumvent service providers or otherentities from blocking the consumer's access to auxiliary data that isrequired to provide enhanced functionality to television 122.

Certain cable, satellite, and IPTV entities typically provide systemusers with set-top boxes that are interfaced to digital televisions viaHDMI uncompressed video interfaces or other appropriate means. If acontent owner wishes to include auxiliary data (such as a URL, applet,etc.) with the content data, and if that auxiliary data travels with thecontent data as a separate digital stream (or as metadata within thecompressed bit stream), the auxiliary data will be blocked at theset-top box 118.

Conventionally, a set-top box 114 does not pass ancillary data streamsin the distribution multiplex, because the set-top box decodes onlyaudio data and video data, and then passes only the uncompressed videodata and audio data across to the television. Ancillary data streams aretherefore unavailable to the television. If service providers (thoseoffering the set-top boxes) perceive that providing access to anyancillary data is competitive to their business model, they may not beinclined to help the consumer electronics industry by providing suchaccess.

By embedding auxiliary data within the video data, the auxiliary datasurvives compression/decompression and is able to arrive intact attelevision 122. In other words, the present invention advantageouslyembeds auxiliary data within the video signal (encoded within the videoimage, not as a separate ancillary data stream). The present inventiontherefore successfully overcomes the architectural roadblock discussedabove. The implementation and utilization of the FIG. 1A electronicsystem 110 is further discussed below in conjunction with FIGS. 1B-8B.

Referring now to FIG. 1B, a diagram of a display 138 from the television122 of FIG. 1A is shown, in accordance with one embodiment of thepresent invention. The FIG. 1B embodiment is presented for purposes ofillustration, and in alternate embodiments, display 138 may beimplemented using components and configurations in addition to, orinstead of, certain of those components and configurations discussed inconjunction with the FIG. 1B embodiment.

In the FIG. 1B embodiment, display 138 includes a main screen regionthat typically displays video data provided by a content source 114(FIG. 1A). In the FIG. 1B embodiment, display 138 also includes a widget144 that resides in a discrete area displayed on display 138 to provideany desired type of additional information. In various differentembodiments, widget 144 may be implemented in any desired shape or size,and may be displayed in any appropriate location. Furthermore, anydesired number of different widgets are equally contemplated, includingthe possibility of multiple widgets on the display at any given time.

In the FIG. 1B embodiment, display 138 supports synchronized widgetsthat function to provide information that is related (synchronized) tothe video data that is currently being displayed on display 138. Forexample, widget 144 may be utilized to display financial information ofspecific relevance to the viewer (e.g., his/her investment portfolio)during a television program regarding economic news or investmenttopics. In another example, widget 144 may be utilized during atelevised automobile race to display relevant information or statisticsregarding specific race car drivers, racecars, or automobile racing ingeneral. Additional details regarding the implementation and utilizationof synchronized widgets 144 is further discussed below in conjunctionwith FIGS. 2-8B.

Referring now to FIG. 2, a block diagram for one embodiment of the FIG.1A content source 114 is shown, in accordance with the presentinvention. In the FIG. 2 embodiment, content source 114 may include, butis not limited to, a central processing unit (CPU) 212, a source memory220, and input/output interfaces (I/O interfaces) 224. In alternateembodiments, content source 114 may be implemented using components andconfigurations in addition to, or instead of, those components andconfigurations discussed in conjunction with the FIG. 2 embodiment. Inaddition, content source 114 may alternately be implemented as any otherdesired type of electronic device or entity.

In the FIG. 2 embodiment, CPU 212 may be implemented to include anyappropriate and compatible microprocessor device(s) that preferablyexecute software instructions to thereby control and manage theoperation of content source 114. In the FIG. 2 embodiment, source memory220 may be implemented to include any combination of desired storagedevices, including, but not limited to, read-only memory (ROM),random-access memory (RAM), and various types of non-volatile memory,such as floppy disks or hard disks. The contents and functionality ofsource memory 220 are further discussed below in conjunction with FIGS.3 and 4.

In the FIG. 2 embodiment, I/O interfaces 224 may include one or moreinput and/or output interfaces to receive and/or transmit any requiredtypes of information for content source 114. For example, in the FIG. 2embodiment, content source 114 may utilize I/O interfaces 224 tocommunicate with other entities in electronic system 110 (FIG. 1A).Furthermore, a system user may utilize I/O interfaces 224 to communicatewith content source 114 by utilizing any appropriate and effectivetechniques. Additional details regarding content source 114 are furtherdiscussed below in conjunction with FIGS. 3-4.

Referring now to FIG. 3, a block diagram for one embodiment of the FIG.2 source memory 220 is shown, in accordance with the present invention.In the FIG. 3 embodiment, source memory 220 includes, but is not limitedto, one or more source applications 312, video data 316, audio data 318,an encoder 320, auxiliary (aux) data 322, an auxiliary (aux) datamanager 324, and miscellaneous information 328. In alternateembodiments, source memory 220 may include components in addition to, orinstead of, those components discussed in conjunction with the FIG. 3embodiment.

In the FIG. 3 embodiment, source application(s) 312 may include programinstructions that are preferably executed by CPU 212 (FIG. 2) to performvarious functions and operations for content source 114. The particularnature and functionality of source application(s) 312 preferably variesdepending upon factors such as the specific type and particularfunctionality of the corresponding content source 114. In the FIG. 3embodiment, video data 316 may include any appropriate information ordata for display on, or for processing within, television 122 (FIG. 1A).Similarly, audio data 318 may include any appropriate information ordata for reproduction by television 122 (FIG. 1A).

In the FIG. 3 embodiment, encoder 320 may include any appropriate meansfor converting video data 316 and audio data 318 into a compresseddistribution multiplex for distribution to television 122. In the FIG. 3embodiment, aux data manager 324 coordinates and manages variousfunctions for creating aux data 322, and embedding aux data 322 as anintegral part of video data 316, in accordance with the presentinvention. Miscellaneous 328 may include any additional information forutilization by content source 114.

In the FIG. 3 embodiment, the present invention is disclosed anddiscussed as being implemented primarily as software. However, inalternate embodiments, some or all of the functions of the presentinvention may be performed by appropriate electronic hardware circuitsthat are configured for performing various functions that are equivalentto those functions of the software modules discussed herein. Additionaldetails regarding the functionality of aux data manager 324 and aux data322 are further discussed below in conjunction with FIGS. 4, 7, and 8.

Referring now to FIG. 4, a block diagram of the FIG. 3 aux data 322 isshown, in accordance with one embodiment of the present invention. Inthe FIG. 4 embodiment, aux data 322 may include, but is not limited to,trigger data 412, widget content 416, synchronization (sync) data 418,content identification (ID) data 420, pointer data 422, andmiscellaneous information 424. In alternate embodiments, aux data 322may be implemented using various components and functionalities inaddition to, or instead of, those components and functionalitiesdiscussed in conjunction with the FIG. 4 embodiment.

In the FIG. 4 embodiment, trigger data 412 may include any type ofinformation that defines various characteristics of a widget 144 (FIG.1B). For example, trigger data 412 may include, but is not limited to,data that defines a widget 144 with respect to widget visual appearanceand behavior, information presented by a widget (such as readoutvalues), widget graphical states (such as colors, levels, or settings),and optimal widget location, shape, size, and display times.

In the FIG. 4 embodiment, widget content 416 may include any contentdata for display in a widget 144. In certain embodiments, widget content416 may alternately be obtained from sources or entities other than auxdata 322. In the FIG. 4 embodiment, synchronization (sync) data 418 mayinclude any appropriate means for allowing television 122 to detect auxdata 322 while it is embedded in video data 316. For example, in certainembodiments, sync data 418 may include a pre-defined identificationpattern that indicates the specific location of aux data 322 withinvideo data 316.

In the FIG. 4 embodiment, content ID data 420 may include anyappropriate information for identifying the specific content of a givencorresponding program. For example, in certain embodiments, content IDdata 420 may include an International Standard Audio-Visual Number(ISAN) number as an identifier. In the FIG. 4 embodiment, pointer data422 may include any type of required information that television 122utilizes to locate and obtain additional information (such as widgetcontent or trigger data) for using in producing synchronized widgets144.

For example, pointer data 422 may include, but is not limited to, a URLthat identifies an Internet location where more information pertainingto the currently-displayed video data 316 may be found. The URL couldrepresent a website on server 130 (FIG. 1A) or elsewhere providing moreinformation about a product being advertised, a URL of a home page of anepisode or series, a website where a viewer could sign up for a serviceor vote on a program, etc. In the FIG. 4 embodiment, miscellaneous 424may include any additional information for utilization by television122. For example, in certain embodiments, miscellaneous 424 may includeone or more scripts or executable programs. Additional details regardingthe creation, distribution, and utilization of aux data 322 are furtherdiscussed below in conjunction with FIGS. 7 and 8.

Referring now to FIG. 5, a block diagram for one embodiment of the FIG.1A television (TV) 122 is shown, in accordance with the presentinvention. In the FIG. 2 embodiment, TV 122 may include, but is notlimited to, a central processing unit (CPU) 512, a display 138, a TVmemory 520, and input/output interfaces (I/O interfaces) 524. Inalternate embodiments, TV 122 may be implemented using components andconfigurations in addition to, or instead of, those components andconfigurations discussed in conjunction with the FIG. 5 embodiment. Inaddition, TV 122 may alternately be implemented as any other desiredtype of electronic device or entity.

In the FIG. 5 embodiment, CPU 512 may be implemented to include anyappropriate and compatible microprocessor device(s) that preferablyexecute software instructions to thereby control and manage theoperation of TV 122. The FIG. 5 display 138 may include any effectivetype of display technology including a cathode-ray-tube monitor or aliquid-crystal display device with an appropriate screen for displayingvarious information to a device user. In the FIG. 5 embodiment, TVmemory 520 may be implemented to include any combination of desiredstorage devices, including, but not limited to, read-only memory (ROM),random-access memory (RAM), and various types of non-volatile memory,such as floppy disks or hard disks. The contents and functionality of TVmemory 520 are further discussed below in conjunction with FIG. 6.

In the FIG. 5 embodiment, I/O interfaces 524 may include one or moreinput and/or output interfaces to receive and/or transmit any requiredtypes of information for TV 122. For example, in the FIG. 5 embodiment,TV 122 may utilize I/O interfaces 524 to communicate with other entitiesin electronic system 110 (FIG. 1A). Furthermore, a system user mayutilize I/O interfaces 524 to communicate with TV 122 by utilizing anyappropriate and effective techniques. Additional details regarding TV122 are further discussed below in conjunction with FIGS. 6-8B.

Referring now to FIG. 6, a block diagram for one embodiment of the FIG.5 TV memory 520 is shown, in accordance with the present invention. Inthe FIG. 6 embodiment, TV memory 520 includes, but is not limited to,one or more TV applications 612, video data 316, audio data 318, adetection module 620, and extraction module 622, an auxiliary (aux) datamodule 624, auxiliary (aux) data 322, and miscellaneous information 628.In alternate embodiments, TV memory 520 may include components inaddition to, or instead of, those components discussed in conjunctionwith the FIG. 6 embodiment.

In the FIG. 6 embodiment, TV application(s) 312 may include programinstructions that are preferably executed by CPU 512 (FIG. 5) to performvarious functions and operations for TV 122. The particular nature andfunctionality of TV application(s) 612 preferably varies depending uponfactors such as the specific type and particular functionality of thecorresponding TV 122. In the FIG. 6 embodiment, video data 316 mayinclude any appropriate information or data for display on television122 (FIG. 1A). Similarly, audio data 318 may include any appropriateinformation or data for reproduction by television 122 (FIG. 1A).

In the FIG. 6 embodiment, detection module 620 may be utilized by TV 122to detect and locate aux data 322 that has been embedded in video data316, as discussed above. In the FIG. 6 embodiment, extraction module 620may be utilized by TV 122 to remove the detected aux data 322 from thevideo data 316. In the FIG. 3 embodiment, aux data module 624coordinates and manages various functions for processing the extractedaux data 322 to effectively support synchronized widgets 144 (FIG. 1B)or other TV applications, in accordance with the present invention.Miscellaneous 628 may include any additional information for utilizationby TV 122.

In the FIG. 6 embodiment, the present invention is disclosed anddiscussed as being implemented primarily as software. However, inalternate embodiments, some or all of the functions of the presentinvention may be performed by appropriate electronic hardware circuitsthat are configured for performing various functions that are equivalentto those functions of the software modules discussed herein. Additionaldetails regarding the functionality of aux data module 324 and aux data322 are further discussed below in conjunction with FIGS. 7 and 8.

Referring now to FIGS. 7A and 7B, diagrams of auxiliary (aux) data 322embedded in video data 316 are shown, in accordance with two differentembodiments of the present invention. FIGS. 7A and 7B present a frontalview of a display 138 from TV 122 (FIG. 1A). The embodiments of FIGS. 7Aand 7B are presented for purposes of illustration, and in alternateembodiments, aux data 322 may be embedded using techniques andconfigurations in addition to, or instead of, certain of thosetechniques and configurations discussed in conjunction with theembodiments of FIGS. 7A and 7B.

In the FIG. 7A embodiment, display 138 includes a main screen regionthat typically displays video data 316 provided by a content source 114(FIG. 1A). In the FIG. 7A embodiment, the displayed video data 316 ondisplay 138 also includes embedded aux data 322 that is preferablylocated in an unobtrusive area of display 138. In various, differentembodiments, aux data 322 may be implemented in any desired shape orsize, and may be displayed in any appropriate location(s) on display138. For purposes of illustration, the aux data 322 in FIG. 7A isdepicted as a small cross-hatched rectangle. However, any effectiveconfiguration or appearance is equally contemplated for implementing auxdata 322.

In the FIG. 7A embodiment, aux data 322 may be encoded to represent anyrequired information (see FIG. 4) in any effective manner. For example,in certain embodiments, aux data 322 may be formatted by utilizingconventional or enhanced bar code technologies. In other words, aux data322 could be effectively formatted as a video two-dimensional bar codethat is embedded in a corner or at the edge of the displayed video data316. In addition, the bar code or other formatting of aux data 322 couldbe displayed as a part of a small graphical logo icon known as a “bug.”Furthermore, in various other embodiments, aux data 322 may encoded ordisplayed by utilizing any other effective techniques. For example, auxdata 322 could be implemented by modulating various attributes ofluminance or chrominance information. In addition, aux data 322 may beimplemented by utilizing multiple display lines.

Such an encoding of aux data 322 could represent a substantial amount ofinformation, and could be quite small and dense, as aux data 322 wouldbe read by the TV 122 processing video data 316 in video memory. Whereprinted barcodes are optimized for readout by laser scanners, the typeof video barcode used for aux data 322 is embedded in a digital videosignal, which is processed directly by the TV 122 (as pixel luminance orchrominance samples).

In certain embodiments, quantization errors in the video compressioncould possibly obliterate a video barcode (so a bar code occurringwithin a fast-moving, hard-to-compress video sequence might notsurvive). However, if the bar code is left on-screen for some amount oftime (a few seconds), that concern is mitigated. The resulting barcodeimage may not need to be shown with high contrast (black lines on whitebackground), since TV 122 will be able to extract the information via afiltering mechanism. The bar code could thus be encoded with variousshades of gray (as long as there is enough contrast for reliableextraction).

As discussed above, aux data 322 could be displayed in conjunction witha graphical logo icon (“bug”), as a caption or border, or it could beplaced at one more of the extreme edges of the image (because these areusually cropped before display, and are less obtrusive in any case). Thebits of aux data 322 could be spread out spatially over the area of thevideo frame if the pattern of their location was known to the TV 122beforehand. Even a small amount of aux data 322, such as the content IDdata 420 or the pointer data 422 of FIG. 4, can be of great help inenhancing the user experience, as this information can be expanded viaan interaction with a web server 130 (see FIG. 1A) to obtain additionalrequired information including, but not limited to, aux data 322 orcontent data.

In the FIG. 7B embodiment, display 138 includes a main screen regionthat typically displays video data 316 provided by a content source 114(FIG. 1A). In the FIG. 7B embodiment, the displayed video data 316 ondisplay 138 also includes embedded aux data 322 that is preferablylocated in an unobtrusive area of display 138. In various differentembodiments, aux data 322 may be implemented in any desired shape orsize, and may be displayed in any appropriate location(s) on display138. For purposes of illustration, the aux data 322 in FIG. 7B isdepicted as a thin cross-hatched line. However, any effectiveconfiguration or appearance is equally contemplated for implementing auxdata 322.

In the FIG. 7B embodiment, aux data 322 may be encoded to represent therequired information (see FIG. 4) in any effective manner. For example,in certain embodiments, aux data 322 may be formatted as one or morehorizontal lines of digital video information positioned in or near theregion of the video signal's vertical blanking interval (VBI). Becausedigital television is often encoded with 1280 to 1920 horizontal pixelsper scan line, the FIG. 7B VBI configuration for aux data 322 mayprovide a substantial amount of digital information to TV 122.

The present invention thus supports a method of camouflaging aux data322 as video data 316 so that a portion of active video (potentiallyvisible to the viewer) is used to convey the aux data 322. In addition,the present invention includes standardizing an encoding format forvideo aux data 322 to survive video compression and decompression. Thepresent invention further supports embedding aux data 322 in the videoimage so that the aux data 322 can be recovered (detected, extracted,and processed by TV 122) in a standardized way, without excessive CPUoverhead. The implementation and utilization of aux data 322 are furtherdiscussed below in conjunction with FIGS. 8A-8C.

Referring now to FIGS. 8A-8C, a flowchart of method steps fordistributing auxiliary data 322 embedded in video data 316 is shown, inaccordance with one embodiment of the present invention. The FIG. 8example is presented for purposes of illustration, and in alternateembodiments, the present invention may utilize steps and sequences otherthan certain of those steps and sequences discussed in conjunction withthe FIG. 8 embodiment.

In the FIG. 8A embodiment, in step 812, a content source 114 or otherappropriate entity initially produces A/V content data that typicallyincludes video data 316 and audio data 318. In step 814, the contentsource 114 or other appropriate entity then creates auxiliary (aux) data322 to support various advanced interactive features on a televisiondevice 122, such as displaying one or more synchronized widgets 144. Instep 816, the content source 114 or other appropriate entity inserts theaux data 322 into the video data 316.

In step 818, the content source 114 or other appropriate entitycompresses the audio data 318 and the video data 316 (including theembedded aux data 322) to create a compressed distribution multiplex.The FIG. 8A process then advances to step 822 of FIG. 8B throughconnecting letter “A.”

In step 822 of FIG. 8B, a set-top box 118 or other appropriate entityreceives and demultiplexes the distribution multiplex distributed bycontent source 114 to produce compressed audio data and video data. Instep 824, a decoder device of set-top box 118 or other appropriateentity then uncompresses the compressed audio data and video data toproduce uncompressed audio data 318 and uncompressed video data 316(including the embedded aux data 322). In step 826, the set-top box 118or other appropriate entity formats the audio data 318 and the videodata 316 for delivery to a display 138 of the television 122. The FIG.8B process then advances to step 828 of FIG. 8C through connectingletter “B.”

In step 828 of FIG. 8C, television 122 or other appropriate entityreceives the uncompressed audio data 318 and uncompressed video data 316(including the embedded aux data 322). In step 830, a detection module620 of the television 122 scans the video data 316 to detect theembedded aux data 322 by utilizing any effective techniques. In step832, an extraction module 622 of television 122 extracts the located auxdata 322 from the video data 316. Finally, in step 834, an aux datamodule 624 processes the extracted aux data 322 to successfully supportappropriate advanced interactive features, such as displaying one ormore synchronized widgets 144 on a display 138 of television 122. TheFIG. 8C process may then terminate.

In certain alternate embodiments, aux data 322 may similarly be createdand inserted into the video data 316 by any other appropriate entity atany point along the distribution path. In certain of these alternateembodiments, aux data 322 may be inserted without completelydecompressing video data 316. For example, individual macro-blocks ofcompressed video data 316 (without any aux data 322) could be replacedby corresponding compressed macro-blocks that contain the aux data 322already embedded. For all of the foregoing reasons, the presentinvention thus provides an improved system and method for distributingauxiliary data embedded in video data.

The invention has been explained above with reference to certainembodiments. Other embodiments will be apparent to those skilled in theart in light of this disclosure. For example, the present invention mayreadily be implemented using configurations and techniques other thanthose described in the embodiments above. Additionally, the presentinvention may effectively be used in conjunction with systems other thanthose described above. Therefore, these and other variations upon thediscussed embodiments are intended to be covered by the presentinvention, which is limited only by the appended claims.

1. (canceled)
 2. A method for receiving video data, the methodcomprising: decoding a distribution multiplex including the video dataembedded with auxiliary data, the auxiliary data including contentidentification data that identifies specific content; and displaying thevideo data and the embedded auxiliary data, wherein the auxiliary datais displayed by modulating pixel luminance or chrominance.
 3. The methodaccording to claim 2, wherein the method further comprises: detectingand extracting the auxiliary data from the distribution multiplex; andexecuting an application related to the video data based on the detectedand extracted auxiliary data.
 4. The method according to claim 3,wherein the detecting and extracting the auxiliary data includesdetecting a predefined pattern in the decoded distribution multiplex,the predefined pattern corresponding to a location of the auxiliary dataembedded in the video data.
 5. The method according to claim 2, whereinthe displayed auxiliary data has rectangular shape.
 6. The methodaccording to claim 2, wherein same auxiliary data is continued to bedisplayed during display of plural frames of the video data.
 7. Areceiving device comprising: circuitry configured to decode adistribution multiplex including the video data embedded with auxiliarydata, the auxiliary data including content identification data thatidentifies specific content; and display the video data and the embeddedauxiliary data, wherein the auxiliary data is displayed by modulatingpixel luminance or chrominance.
 8. The receiving device according toclaim 7, wherein the circuitry is further configured to: detect andextract the auxiliary data from the distribution multiplex; and executean application related to the video data based on the detected andextracted auxiliary data.
 9. The receiving device according to claim 8,wherein the detecting and extracting the auxiliary data includesdetecting a predefined pattern in the decoded distribution multiplex,the predefined pattern corresponding to a location of the auxiliary dataembedded in the video data.
 10. The receiving device according to claim7, wherein the displayed auxiliary data has rectangular shape.
 11. Thereceiving device according to claim 7, wherein same auxiliary data iscontinued to be displayed during display of plural frames of the videodata.
 12. A method for distributing video data, the method comprising:embedding auxiliary data into video data; encoding the video dataembedded with the auxiliary data to create a distribution multiplex, theauxiliary data includes content identification data that identifiesspecific content and is encoded with pixel luminance or chrominance;distributing the distribution multiplex to at least one receiving devicethrough a distribution network.
 13. The method according to claim 12,wherein the auxiliary data is used to execute an application related tothe video data by the at least one receiving device.
 14. The methodaccording to claim 12, wherein the auxiliary data includes a predefinedpattern, the predefined pattern corresponding to a location of theauxiliary data embedded in the video data.
 15. The method according toclaim 12, wherein the auxiliary data is embedded in the video data suchthat the auxiliary data displayed by the at least one receiving devicehas rectangular shape.
 16. The method according to claim 12, wherein thesame auxiliary data is embedded into plural frames of the video data.17. A distribution device comprising: circuitry configured to embedauxiliary data into video data; encode the video data embedded with theauxiliary data to create a distribution multiplex, the auxiliary dataincludes content identification data that identifies specific contentand is encoded with pixel luminance or chrominance; distribute thedistribution multiplex to at least one receiving device through adistribution network.
 18. The distribution device according to claim 17,wherein the auxiliary data is used to execute an application related tothe video data by the at least one receiving device.
 19. Thedistribution device according to claim 17, wherein the auxiliary dataincludes a predefined pattern, the predefined pattern corresponding to alocation of the auxiliary data embedded in the video data.
 20. Thedistribution device according to claim 17, wherein the auxiliary data isembedded in the video data such that the auxiliary data displayed by theat least one receiving device has rectangular shape.
 21. Thedistribution device according to claim 17, wherein the same auxiliarydata is embedded into plural frames of the video data.